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We generalize the Clausius (in)equality to overdamped mesoscopic and macro- 
scopic diffusions in the presence of nonconservative forces. In contrast to previous 
frameworks, we use a decomposition scheme for heat which is based on an exact 
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variant of the Minimum Entropy Production Principle as obtained from dynamical 
fluctuation theory. This new extended heat theorem holds true for arbitrary driving 
and does not require assumptions of local or close to equilibrium. The argument 
remains exactly intact for diffusing fields where the fields correspond to macroscopic 
profiles of interacting particles under hydrodynamic fluctuations. We also show that 



the change of Shannon entropy is related to the antisymmetric part under a modified 
time-reversal of the time-integrated entropy flux. 
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I. INTRODUCTION 
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C<") . The Clausius heat theorem stands at the very beginning of the theory of equilibrium ther- 

■^j- \ modynamics Grown out of meditations on the efficiency of heat machines [2J, Clausius 



discovered that for quasi-static processes between equilibria, heat divided by temperature 



m 

^ , is an exact differential, memorized as 5Q/T = dS. The new state function S was called 
the entropy of the system (in equilibrium). Clausius continued by arguing that this entropy 

X : never decreases for systems in thermal isolation ' or ' more generally for arbitrary processes 

in which the system moves from an initial to a final equilibrium holds 
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where 5Q is the incoming heat while in consecutive contact with thermal baths at temper- 
ature T (and again, with equality for quasi-static processes). From the point of view of 
statistical mechanics and in particular in retrospect from the equilibrium fluctuation theory 
developed by Boltzmann, Planck and Einstein, that Clausius relation appears challenging. 
Indeed, thinking of entropy as the logarithmic volume of regions on the constant energy sur- 
face corresponding to some macroscopic condition, inscribed as S = ks logW, the relation 
with heat is less evident. The fact that basically the same entropy covers quite different 
physical aspects for processes satisfying detailed balance (including also its role in defining 
thermodynamic forces and in the fluctuation-dissipation theorem) does of course not imply 
that the Clausius entropy and the Boltzmann entropy, even in their versions for open sys- 
tems, must remain strictly connected also away from equilibrium when currents of particles 
or energy are maintained, [3]. Yet it was found by Komatsu, Nakagawa, Sasa and Tasaki that 



detailed balance for which 
4j — the basic reason there 



close-to-equilibrium, in fact for Markov processes satisfying loca 
the driving is small, a slightly modified Clausius relation is valid 
is the approximate validity of the MacLennan-Zubarev ensemble for which the occupations 
are still determined by heat jsj or, as we will show, the approximate validity of the Mini- 
mum Entropy Production Principle (MEPP) jg]. Still another proposed generalization, even 
formally exact arbitrarily far from equilibrium though offering less direct interpretation and 
applications, was earlier given by Hatano and Sasa [7|, by using an intricate decomposition 
of heat into steady-state and excess components. 

The present paper proposes a new heat renormalization under which the Clausius 
relation continues to hold outside the linear regime around equilibrium, and which in a 
sense enjoys virtues of the two proposals mentioned before, at least for diffusions in the 
overdamped regime. Starting by the observation that the limited validity of the generalized 
Clausius equality in {4] is intimately related to the breaking of the MEPP, we present 
a modification which remains exactly valid. Such a modification is indeed possible by 
employing dynamical fluctuation theory, which provides a general framework under which 
variational functionals are constructed as large-fluctuation potentials. Though presently 
restricted to overdamped diffusions where a simple interpretation emerges, this new 
approach offers a more systematic way of generalizing various equilibrium-like concepts and 
relations which goes beyond trial-and-error. It also shows the relevance of large fluctuations 
for the energetics of mesoscopic thermodynamic machines. 
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The plan of the paper is then as follows. We start in the next section with the meaning 
of extending Clausius heat theorem to nonequilibrium; we discuss thermodynamic transfor- 
mations and we introduce in general terms the core of the argument. A review of previous 
results on mesoscopic nonequilibrium extensions of Clausius' heat theorem is presented in 
Section IHII These are mostly found in the project of steady state thermodynamics carried 
forward in |4|, |5|, |7J, lS| ■ We restrict ourselves also there to the set-up of overdamped diffusions. 
The basic inspiration of the present paper is to pass via dynamical fluctuation theory, 
in particular dealing with the fluctuations of the occupation times. That is explained in 
Section [IV] and in llVBl in particular. An extension to macroscopic boundary- driven diffusion 
in a form which is similar yet fundamentally different from the recent contributions ^, [l(3] 
will be given in Section |V] The last Section I VI I takes another point of view and deliv- 
ers an exact Clausius equality obtained by the appropriate time-reversal on the entropy flux. 

Herbert Spohn has certainly been a pioneer of bringing dynamical large deviation theory 
to shed light on nonequilibrium questions. One of the many examples are found in Section 



3.7 in his book 11] where he finds the entropy production as a path-wise quantity (dynamical 
contribution to the rate function) in the nonequilibrium action. That is actually crucial in 
the fluctuation- understanding of the minimum entropy production principle, as used also in 
the present paper. 

II. THE MEANING OF EXTENDING CLAUSIUS HEAT THEOREM 

As is often the case, extending an equilibrium idea or an equilibrium relation to nonequi- 
librium is not uniquely defined and its relevance is not immediate. The Clausius heat 
theorem can be read in different ways for the purpose of extensions. On the one hand, 
one remains interested in the question what kind of excess heat over temperature gives rise 
to an exact differential, and in the general question of thermal properties of nonequilib- 
rium thermodynamic processes. That is asking for extensions to nonequilibrium calorimetry 
and to discover thermodynamic potentials that generate thermal response and conduction 



also in nonequilibrium systems, 12] . On the other hand, one is interested in the possi- 



ble thermodynamic relevance and interpretation of the Shannon or other entropic measures 
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of the nonequilibrium statistics for stochastic systems, as well as of the local equilibrium 
(Gibbsian) entropies on the macroscopic scale. The more general challenge is here to get 
operational thermodynamic meaning to the static fluctuation functionals (sometimes called 
nonequilibrium free energies) for nonequilibrium systems. 

A. Thermodynamic transformations 

Central to the Clausius heat theorem is the notion of thermodynamic transformation. 
One considers a number of control parameters a such as the temperature of the environment 
and the volume of the system and one watches the system as these are being changed. In 
the original version, that is between an initial and a final equilibrium condition. When the 
transformation is quasi-static, then at each moment the condition of the system remains 
that of instantaneous equilibrium. In equilibrium statistical terms the Clausius equality 
then reads 

p(d(E v )-^)dv^ =d(\ogZ(a) + P(E v )), a=(v,/3) (1) 

connecting canonical equilibria p a {x) = exp[— /3E v (x)]/Z(a) at inverse temperature (3 for 
energy function E v for example depending on a length scale v. The left-hand side is heat 
over temperature (35Q, as follows from the first law of thermodynamics. The right-hand side 
is the change dS in (physical) entropy of the equilibrium system as given by the Shannon 
entropy of the Gibbs canonical distribution. For more general transformations (not quasi- 
static) the usual inequality (35Q < dS applies in (TfJ). 

Exactly because its central subject is to connect various equilibria, the Clausius statement 
naturally relates with questions of relaxation to and response in equilibrium. Nature appears 
to accompany these processes of relaxation and response with dissipation, as also appears 
in the fluctuation-dissipation theorem. 

Nonequilibrium thermodynamics wants to consider processes that connect stationary 
nonequilibria, where besides the more standard control in terms of environment temper- 
ature (s) or volume, now also manipulations of the driving condition can be part of the 
scheme. Again aspects of relaxation to and thermal response in nonequilibrium stationary 
regimes will be crucial although the latter is far from obvious in our present approach. A 
first difference here with equilibrium thermodynamics is the presence of heat also under 
stationary nonequilibrium. Even when the system runs stationary, a flow of energy or 
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particles is maintained, giving rise to Joule heating or dissipation. That will lead to 
questions of renormalization schemes that define excess heat so to pick up exactly and 
only that heat which is (entirely) due to the transforming between nonequilibria. There 
are however good reasons to think that heat and dissipation as formulated in irreversible 
thermodynamics will no longer be sufficient to characterize these relaxation processes. That 
is the more important second difference with equilibrium. We believe that kinetic aspects 
such as those summarized under the name of dynamical activity will become important, 
and indeed some of that is visible in linear response around nonequilibria, [13|. That will 
also be taken up in Section TlVBI Yet, while our approach stems from considerations on the 
dynamical activity, for the purpose of staying close to the original meaning of the Clausius 
theorem we restrict ourselves here exactly to a set-up where the dynamical activity (excess) 
is precisely given by the entropy production (excess). 

On the more technical side of the question is the mathematical modeling of thermo- 
dynamic transformations. That is monitored via the control parameter which makes the 
time-evolution of the dynamical variables time-inhomogeneous. 

The dynamical variables are reduced variables such as macroscopic observables, profiles or 
the mechanical states of subsystems. To give an example in the context of Markov processes, 
we consider the Master equation for probability distributions fi t , 

fit = L a{t) p u 0<t<r (2) 

where the linear operator L a is the forward generator of a Markov process for each fixed value 
of a. We assume a smooth dependence and evolution with a unique stationary distribution 
p a satisfying L a p a = for each a. 
To incorporate quasi-static changes, we take 

a £ (t) := a{et), < e < 1, < t < £ _1 r (3) 

and denote the solution of the Master equation (j2J) by p,^ for pf2 = p a (o) = Pim, where 
we start from a stationary distribution for an initial choice of control parameter. Under 
the quasi-static limit e j. the probabilities /4 tend to the stationary nonequilibria, with 
correction 

P% = Pa(t) + 0(e) (4) 
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Here are some possible examples: 

1. Driven multilevel systems: we consider then Markov jump processes on the possible 
energy levels of a system. These can be obtained from weak coupling limits of finite 
quantum systems in contact with thermal reservoirs as derived for example in jl^j ]. 
When they are driven, population inversions can occur such as in lasers where the 
protocol a would refer to the pumping amplitude (together with environment temper- 
ature and volume of the cavity). The stationary level statistics p a is then no longer 
given by the Boltzmann equilibrium distribution; rather p a depends non-trivially on 



a. See also 



15] for calorimetric considerations. 



2. Driven Brownian particles: that is the set-up for colloids on which rotational forces act 
in a viscous equilibrium medium. The dynamical variable is the position of the colloid. 
We will see the formalism in the next section; the protocol a(t) regulates conservative 
and non-conservative fields, together with the temperature of the medium. 

3. Diffusion processes under hydrodynamic scaling: these appear as infinite dimensional 
versions of the previous example. They can represent the rescaled dynamics of inter- 



acting particle systems at least when the hydrodynamic scaling is diffusive, Il6 |. 
They work mostly under the assumption of local equilibrium and the protocol a(t) 
regulates the temperature and the external conservative fields. We will see an ex- 
ample in Section |V] but the set-up is more generally that of standard irreversible 
thermodynamics. 



B. Within irreversible thermodynamics 

There is, as far as we know, not a unique notion of nonequilibrium entropy. Within the 
set-up of irreversible thermodynamics however the entropy of a macroscopic system remains 
defined in local equilibrium. The system can be driven either in the bulk or from the 
boundary but it is assumed that the ideas of heterogeneous equilibrium remain in place. In 
particular that means that there is well-defined entropy density s(r, t), r 6 Q of the system 
in volume Q satisfying a balance equation 

3s 

— + div J s (t) = a(t) (5) 
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in terms of the entropy flux J s (t) to the environment and the entropy production a(t). We 



refer to 17J for the general theory, phenomenology and concrete realizations. Later sections 
will also add details within specific set-ups but here we only sketch the line of the argument. 
The time-dependence in (J3J) arises from two sources. First from the thermodynamic trans- 
formation a(t) as we had above, and secondly from the time-evolution of the macroscopic 
variables v(r,t) which itself depends again on the protocol a(t). These dynamical variables 
are mostly defined in terms of density, velocity and/or energy profiles through the volume of 
the system so that the time-evolution is obtained from a continuity equation together with 
constitutive equations. That also implies definitions of fluxes J l a (r,t) and thermodynamic 
forces X l a (r,t) which define the (local) entropy production (rate) 

a{t) = a a(t) (r,t) = ^ J*(r, t) X { a (r, t) > 

i 

as a sum over the various channels i of dissipation. Similarly, the entropy flux J s in (J5j) 
is defined in terms of the energy and the particles crossing the boundary dVt taking into 
account also the boundary conditions that can be part of the control a. 



The argument starts by considering a fixed choice a of the control (not depending on 
time). Then it makes sense to ask for the stationary profile v a (r), time- invariant solution of 
the local equilibrium hydrodynamics. When evaluating ([5]) for that profile we have 

div J s (v a (r)) = a a (u a (r)) 

meaning that the stationary entropy production is entirely given in terms of the rate of 
change of the entropy in the environment. We can write that for each value a(t) along the 
protocol and hence we can add their difference to §5§ without change: 

ds 

— = div J s {v a{t) (r)) - div J s {t) + a(t) - a a{t) {u a{t) (r)) (6) 

One could expect that under quasi-static transformations (jlj), cr(t) — cr a (j)(^ a (t)(r)) yields a 
negligible contribution, yet this is not the case in general. Although a{t) — cr Q (i)(^ Q (t)(r)) = 
0(e), cf. dH), its total contribution to the thermodynamic process is 

/ ' [a(t)-a a{t) (v a{t) (r))]dt = 0(l) 
Jo 
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and hence it remains relevant. To obtain both the Clausius equality in the quasi-static limit 
and the inequality beyond that limit, we would rather need the relation cr{t)—a a t t ) {v a (t) = 
0(e 2 ) > 0, which essentially amounts to the validity of a minimum entropy production 
principle. However, it is well known that such an (approximative) variational principle is 
restricted to the linear irreversible regime in which the fluxes J^(r,t) are linearly dependent 
on the forces X^(r } t), see [n]|. In that regime the sum of the last two terms in §6§ after time- 
integration remains negligible and we can write the quasi-static entropy balance equation 



which is a Clausius equality for the entropy of the system under quasi-static evolutions in 
standard irreversible thermodynamics. The entropy flux got renormalized by subtracting 
the instantaneous stationary entropy flux. Note however, that even in the linear irreversible 
framework the above equality does not immediately extend to an inequality for non quasi- 
static processes, the basic reason being that a strongly non quasi-static evolution easily 
breaks the restrictions of the linear irreversible framework. A precise argument valid also 
outside the set-up of irreversible thermodynamics but for close-to-quasi-static evolutions 
follows around eq. f fT7|) . 

The new idea of the paper is to formulate a modification of the minimum entropy produc- 
tion principle which does remain valid arbitrarily far from equilibrium, at least for diffusions 
without inertial degrees of freedom. Since it naturally follows from dynamical fluctuations of 
driven Brownian particles, we first formulate our proposal within the "single-particle" frame- 
work where the entropy function simply boils down to the Shannon entropy (Section HVj) . 
That however enables a direct generalization to a class of driven macroscopic diffusions 
at local equilibrium, including those driven by boundary thermodynamic forces (a specific 
scenario will be discussed in Section |V} . 



We consider a Brownian particle moving in some (possibly multidimensional) spatially 
and temporally dependent environment, which is coupled to a heat bath and driven by 
non-conservative forces. It is introduced by the Ito stochastic equation 



ds 
dt 



+ div [J s (t) - J s (Va(t))} = 



III. MODEL AND PREVIOUS RESULTS 



dx t = 0D(f - VU) dt + V ■ D dt + (2D) 



' 2 dW t 



(7) 
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with Wt the standard Wiener process and for some driving force / = ft{x), potential land- 
scape U = U t (x), inverse temperature (3 = j3 t = {k B T t )~ l and positive diffusion matrix 
D = D t (x). In accordance with the Einstein relation, the matrix (3D corresponds to the 
particle's mobility. The time- dependent probability distribution evolves according to the 
Smoluchowski equation 

|^ + V-< t = (8) 

with the current density = fi(3D (/ — VU) — DVfi. That is a version of the Master 
equation §Z§ for a — (/, U, (3, D). The time- dependence will often not be explicitly denoted. 
We have added the superscript U to indicate the dependence on the potential landscape 
which plays an essential role in our argument below. We put no restrictions on the 
space-time dependence of the model parameters except for the usual smoothness and 
ergodicity conditions. In particular, we assume that the potential U is sufficiently confining 
so that normalizable solutions to the stationary equation V ■ = always exist. We also 
assume either free boundary conditions at infinity, or that the Brownian particle moves on 
the one- dimensional circle (= periodic boundary conditions). The meaning of probabilities 
is here most simply that fit represents the density of many independent particles at 
position x; that is also why the Shannon entropy S(fi) = — J /ilog/idx (kg = 1) is here the 
relevant thermodynamic entropy. Models of interacting particles will be treated in Section IVl 

The main point of departure in all that follows is the balance equation: under (jHJ), 

tm-pKm+sw (9) 

dt H dt VAV v ; 

with mean incoming heat flux 

5Q u (ji) l^ TT dx t 



dt \ dt i n 



(VU-f)o 

(10) 

(VU - /) • Jl dx 



and entropy production rate 

a u (ji) = J J? -(JMD)- 1 tfdx>0 (11) 

The balance can be further improved because, in the presence of a nonequilibrium driv- 
ing even for arbitrarily slow processes, the entropy production rate a v (//) remains nonzero, 
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indicating the irreversibility. Time-integrating over long times (as for quasi-static pro- 
cesses (j3J)) would result in infinities. How to renormalize that balance equation while keeping 
physically interesting excess quantities is the first challenge in extending the Clausius heat 
theorem. It leads to a number of different proposals as we now first briefly review. 



A. Hatano-Sasa approach 

Hatano and Sasa j3] have proposed to separate from the total heat its "house-keeping" 
component as corresponding to the (as far as we see, artificial) force / — VU — V log p 
with p the stationary density solving the stationary equation V- Jp = 0. This house-keeping 
heat has the instantaneous expectation 

^-(w-f + rvw*), (i2) 

= -/ jv-ipPDr 1 ^^ 

to be compared wit h (1111) . That definition of the house- keeping heat relates to time- reversal 
considerations, see 18j. Observe that under the detailed balance condition which is realized 
for / = 0, the stationary density has the Gibbsian form logp = —f3U + const and = 0; 
hence SQ hk /dt = 0. 

The "excess" component SQ ns in the decomposition 5Q U = 5Q hk + 5Q RS reads 

SQ HS (p) 



0- 1 J Vlogp- jjjdx (13) 



dt 

and the entropy balance (jHJ) obtains the form 

Since the integral on the right-hand side is manifestly nonnegative, we arrive at the exact 
Clausius- type inequality dS(p) > (3 5Q ns . 

Now we take a generic thermodynamic process as in Section III Al specified by some pro- 
tocol a(t) = (f t ,Ut, /3t, D t ), < t < r. We consider its re-scaled variant a^ £ '(t) = a(et), 
< t < t je in the quasi-static limit e 4- as in (j3]). Under standard conditions for the adi- 
abatic theorem to hold true, see 01]), the instantaneous densities solving the Smoluchowski 
equation OH]) under the protocol a^(t) are of the form jjjf* = p^ + O(e) where p^f* is the 
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stationary density at fixed condition a = a^ £ \t). As a consequence, the integral on the right- 
hand side of ffT4l) is 0(e 2 ) and the time integral of that balance equation from t = t; n i = 
till t = tfin = r/e reads 

S{£1) - SM = f' £ P { t £) 6Q m ^^ t ) + 0(e) (15) 
J o 

yielding an equality in the limit e 4- 0, with S(fio) = S(p ini ) and S(ji^}) — >■ S(pa n ). (Note 
that for a rigorous treatment some further regularity assumptions are needed to ensure 
time uniformity of the e— expansions.) 



As obvious from the construction, the essence of the method lies in formally replacing the 
actual mechanical force / — VZ7 with the "thermodynamic" force derived from the station- 
ary potential — f3^ 1 logp; the heat produced by this fictitious force matches the fluctuating 
excess heat. However, it is not obvious how to operationally access either the house-keeping 
heat ffl~2l) or directly the excess heat ffT3l) . due to the nontrivial dependence on both densities 
p and /i. A "non-calorimetric" experimental verification has been reported in 19]. 

A precise formulation of the Hatano-Sasa approach aided and connected with fluctuation 
symmetries can be found in ]j| , in particular relevant via their Example 12 on page 492 of 
that paper. In fact, the Hatano-Sasa work is truly a formal nonequilibrium generalization 
of the Jarzynski equality. Here we have emphasized the part that fits the subject of the 
present paper. 



B. Komatsu-Nakagawa-Sasa-Tasaki approach 

A somewhat different road has been proposed in 4| where the heat is decomposed in 
such a way that its steady-state component allows for a more direct interpretation and 
experimental access. Next we review this method in a slightly modified way which better 
reveals how it is related to our approach that will be discussed later. 

Here the decomposition is done by subsequently removing from the heat the integrated 
steady heat flux 6Q u (p)/dt = J (VZ7 — /) • Jp dx, again with p being the stationary density, 
V ■ Jp = 0. By stationarity, — 5Q u (p)/dt = u u (p) and the balance relation (j^J) can be 
written in terms of the remaining ("excess") heat 5Q ex (/z) = 5Q U (p) — 5Q u (p) as 

m. = „^L + ^ ijl) -^ {p) (i6) 
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In contrast to the previous approach, the removed steady-state flux and hence also the 
remaining excess heat are in principle directly accessible. However, the difference cr u (p) — 
<J U (p) can in general take both positive and negative values unless further restrictions are 
imposed as explained next. 

Close to equilibrium, i.e. for weak non-conservative forces and small deviations from 
stationarity, the entropy production cr u (p) as a function of density \x attains its minimum at 
jji* ~ p — the Minimum Entropy Production Principle (MEPP). Then, a (/•«) — cr u (p) > in 
(TT5|) which gives the Clausius inequality. More precisely, we write / = A/i and \og(p/ p^) = 
(gi with A and ( control parameters, and we expand the entropy production difference 
around ( = A = 0. For any (smooth) fi and g± ^ 0, 

a u (p) - a u (p^) = C 2 B(\) + 0(CA 2 , C 3 ) (17) 

with some function B(X) > b > in a neighborhood of A = 0. In particular, if taking 
A = 0(Q, we obtain cr u (p) > a u (p^) in a neighborhood of £ = 0. Whenever this vari- 
ational principle can (at least approximately) be verified, the balance equation (TT6|) yields 
the generalized Clausius-type inequality dS(p) > (3 5Q ex (/i). 

Finally we combine the close-to-equilibrium expansion with the quasi-static expansion 
(ED — (SD - For a thermodynamic process defined by a re-scaled protocol a £ (t), < t < r/e 
as before, we have ( = 0(e) by the adiabatic theorem, and therefore the entropy balance 
equation obtains the time-integrated form 4| 

S(ji®) - S(p ) = [ T/£ f3 t 5Q c ^(p t ) + eC(X) + 0(A 2 , e 2 ) (18) 

with some C(A) > c > in a neighborhood of A = 0. The second term on the right-hand 
side vanishes in the quasi-static limit e \. 0, whereas the remaining (indefinite) corrections 
only appear in quadratic order around equilibrium. An exact inequality is again verified, 
e.g., for A = 0(e) in a neighborhood of e — 0, with the strict equality in the (quasi-static 
and equilibrium) limit e \. 0. 

Although this approach deals with physically more directly accessible quantities, its draw- 
back obviously lies in its limitation to the close-to-equilibrium regime, and we have seen how 
it originates from the violation of the MEPP. But a deeper understanding of that minimum 
entropy production principle arises from the study of dynamical fluctuations, 6|. The next 
section and main result of the paper is in fact directly inspired by looking at the rate function 
of occupation time statistics. 
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IV. MODIFIED CLAUSIUS THEOREM 



Our strategy to overcome the above restrictions will be to first find a modification of the 
minimum entropy production principle which remains exactly valid far from equilibrium, 
and then to apply the corresponding decomposition scheme for heat. We show that this 
problem has a surprisingly simple solution, at least within the framework of overdamped 
diffusions to which we restrict here. This approach is motivated and is intimately related to 
the theory of dynamical fluctuations; this connection will be explained afterwards. 



A. Heat decomposition from an exact MEPP 

Given the entropy production <J U (/J,) by equation pip , we now consider it as a functional 
of the potential landscape U, and with the density fi and all other system parameters fixed. 
It is easy to check that this functional is convex and 

^ = *V-J? (19) 

Hence its minimizer V = satisfies V ■ = 0, i.e., it is such a potential landscape that 
makes the density /i stationary. The solvability and uniqueness of this inverse statio nary 



problem has been studied in the context of Donsker-Varadhan theory of large deviations 20]. 
The resulting inequality & u (fi) > & v (n) can be interpreted as a modified MEPP, stating 
that: Among all possible potential landscapes, the system at a given state dissipates the least 
at stationary conditions. 

This "complementary" variant of the usual (approximative) MEPP principle provides a 
variational formulation of the inverse stationary problem, i.e., to find a potential U that 
makes a given density \x stationary. In contrast to the original principle (or hypothesis), 
our version remains exactly valid arbitrarily far from equilibrium. We remark that the 
optimal potential V^ 1 is a non-local functional of the density \x, in the sense of long-range 



dependencies in the linear response function x{ x iV) = dV^(x)/dfi(y) [21]. 



We now propose to decompose the heat via the integrated steady fluxes obtained from the 
inverse (instead of the direct as before) stationary problem. The new heat decomposition 
reads 

SQ u (ji) = SQ v (fi) + 6Q mcx (fi) (20) 



14 



where 

= /(W - f) ■ Jl dx = -a v (p) (21) 

is a modified steady-state heat flux but now with respect to the steady state specified by the 
density \i (and under the potential V = V^ accommodated so that it provides a stationary 
condition for that p). The modified excess component is 

5Q mcx (/i) 



/ (W - /) • {J" - Jj) dx (22) 



dt 

and the entropy balance equation ([9]) obtains the form 

which is very similar to the relation (TIB"]) . However, in contrast to the latter, the modified 
MEPP now implies the exact Clausius-type inequality dS(p) > f35Q mcx (p) without any 
close-to-equilibrium restrictions. Upon time-integration along some thermodynamic protocol 
a(t), < t < t, we get 

S{fir) - S(hq) > [ T f3 t SQ mcx (p t ) (24) 

Jo 

The quasi-static equality follows by adjusting the argument from the previous sections. 
Again with e the quasi-static control parameter we write the time-integral of the balance 
equation in the form 

S(H { ±) - S(jm>) = [ T/£ A (£) 5Q mex ' e (/iJ £) ) + f V*" - ^ Vu£ )^t ) ) dt (25) 
Jo Jo 

where pif 1 is the solution of the Smoluchowski equation ([S]) with the system parameters 
according to the protocol a^ £ \t) = a(et). The dynamical dependence of the entropy pro- 
duction a on e is via a^ £ \t), i.e., it depends on the conditions at time t. There is however 
also the dependence on the potential, which enables introducing an e— expansion for the 
difference in the second integral, as now follows. We assume that this expansion can be 
made uniformly with respect to the non-rescaled time t G [0, r]. 

Using that p^ = p{ + 0(e) we apply the implicit function theorem to the inverse sta- 
tionary problem to get = + 0(e). Hence a Ut ' E (p[ ) = a Vt ' £ (fif) + 0(e 2 ) since, by 
construction, the functional a u, ^(fi £ ) takes its minimum at U = v} £ \ Therefore the second 
time- integral in fl25l) is 0(e) and we get in the quasi-static limit 

S( P&n ) - S( Pini ) = lim [ T/£ A (e) 5Q mcx < £ (/4 £) ) (26) 

elO J Q 
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This variant (j24p and (I26p of the nonequilibrium Clausius heat theorem is our first (main) 
result. 



B. Connection to dynamical fluctuations 

It is by now rather well understood how various equilibrium and nonequilibrium varia- 
tional principles originate from the study of (either static or dynamic) fluctuations, exam- 
ples being provided by Einstein's static and Onsager-Machlup's dynamic fluctuation theories 
which have obtained many generalizations, e.g., in the context of fluctuating hydrodynam- 



ics, 16]. Here we make use of results obtained in [20] to relate our renormalized entropy 
production to a fluctuation potential so that the origin of the modified MEPP which has 
been a key ingredient in our argument, gets further clarified. 

We study the question of how plausible it would be to observe the intermediate density \x t 
the system exhibits at each time t, as the actual empirical occupation statistics with respect 
to the steady dynamics at "frozen" parameters ft,Ut, j3 t , D t . From the observed realization 
(x t + s )l=o °f t na ^ steady process we extract the time-averaged occupation density 

p T t (z) = - [ 5(x t+s -z)ds (27) 
T Jo 

By the assumed ergodicity, p\{z) typically converges to p t for r — >■ +oo. The general result 
about the probability of untypical empirical densities reads that it has the exponential 
asymptotic form (r — > +oo), 

P(pl ~ fi t ) = exp [-rI Ut (p t ) + o(t)] (28) 



For the diffusion processes under consideration the rate function has the form, see 20] . 



I u (p) = \ [a u (p) - a v (p)] , V • Jl = (29) 

By construction, I u (fi) > with equality if and only if V • = 0. Fixing U and taking 
density \i as a variable, that provides the approximative MEPP principle invoked in Sec- 



[6]. On 



the other 



tion IIIIBl since, in the notation used therein, cr v (p) = cr u (p) + 0(eA 2 , e 3 ), 
hand, fixing \i and varying U, we immediately obtain the MEPP introduced in Section IIV Al 
and applied in our new heat decomposition scheme. 

Combining eqs. fl23|) and (129]) . the modified excess heat can be written in the form 

dt dt v ; 



16 



which directly links the probability of rare dynamical events to the violation of the extended 
Clausius theorem. That summarizes the major point of the paper. 



V. MACROSCOPIC BOUNDARY-DRIVEN DIFFUSION 

So far we have restricted ourselves to finite diffusions which are most easily interpreted 
for independent particles. Yet our formalism allows a rather straightforward extension 
to a class of macroscopic bulk- and boundary- driven diffusion systems. The reason is 
that the macroscopic density profile evolves with time according to a non-linear variant 
of the Smoluchowski equation, with a density-dependent diffusion matrix derived from 
microscopic details of particle interactions. Whereas this extra nonlinearity does not require 
any essential changes in the construction of the modified excess heat, the incorporation of 
(possibly time- dependent) boundary conditions demands some modifications that will be 
explained below. 

As a specific model we consider a Brownian fluid described by the density profile n = n t (r) 
in a bounded domain Q. We assume the fluid to be locally always at equilibrium with a heat 
bath at inverse temperature T t = 1/(/cb^), but globally being driven out of equilibrium via 
maintaining a spatially inhomogeneous chemical potential profile at the system's boundary. 
(Adding a bulk field would also be possible.) The (thermo) dynamics of the system is specified 
via (1) a free energy density functional 4>(n t (r),T t ) describing the local equilibrium in the 
bulk, via (2) a positive-definite mobility matrix A(n t (r)), and via (3) a boundary profile 
of the chemical potential a t (r)\ re gci. Adding the variable control field U t {r) vanishing on 
the boundary, U t (r) = for all r e dfl, the density profile evolves following the continuity 
equation 

+ V-Jf(r)=0 (31) 



dt 

with the current density functional 



J? (r) = -A( n ,(r))v(»*^» + I/,(r)) (32) 
and the boundary condition 

a t (r)\r&dn (33) 



d<P(n t (r),T t ) 
dn 



redn 
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For simplicity, we restrict ourselves (as indicated above) to thermodynamic processes 
corresponding to time-dependent bulk temperature T f , the boundary chemical potentials 
a t {r) and the control field U t (r), though various generalizations are easy to obtain. 

For the total free energy 3>t(r) = J n (j)(nt(r),T t ) dr we have 



d/ S * dt + / Vat(r) ' J * (r) ^ " t "* (r) J * (r) ' dS (34) 

where St — — J n d4>(n t (r),T t )/dT dr is the total entropy and «t(r) = d(p(n t (r),T t )/dn is the 
local chemical potential. The last term is over the boundary of Q and arises, together with 
the second term, from partial integration. 

To fit the equation (1341) in the standard framework of irreversible thermodynamics, we 
rewrite it in terms of the total energy £f = $j + T t St + J Ut(r)nt(r)dr (including the 
energy of the control field), as 



Tt ^ = ^ - / ^ n t (r) dr + f V{a t + U t ){r) ■ jf (r) dr - t 



a t (r) • Jf(r) dE 



an 

(35) 

where the first integral on the right-hand side is (minus) the work of the control field and the 
last integral is the convective energy outflow. Hence, there has appeared the total (incoming) 
heat 

5Ql = d£l f dU t {r) 
dt dt 

from both the bulk and the boundary reservoirs. Similarly, we recognize in (135]) also the 
entropy production functional 



Jn d * Jdn 



j-1 



1 

Tt Jn 

so that we finally get the standard entropy balance 



- / V(a t + U t )(r)- J?(r)dr 

It J a (37) 
jf(r) • A- X (n t (r))jf (r) dr > 



dt T t dt 

We have arrived at the diffusion scheme of (15|)— (jlip . 



dS '- 1 ^ + .f (38) 
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Now we are ready to apply the analogous heat decomposition scheme as in Section IIV Al 
Since a v is a convex quadratic functional of the control field U and using that 

4 V ' jV(r) m 

everywhere in the interior of volume Q (recall that by definition U vanishes on the boundary 
dQ) we again obtain the modified MEPP, according to which the stationarity condition 
V ■ J u = for the field U is equivalent to the minimization of the entropy production 
functional a u on the space of all (smooth) fields U, U(r)\ re gv = 0. Skipping the rigorous 
treatment of this variational problem, we now continue exactly as in Section IIV Al to define 
the modified excess heat, by removing from the heat its steady flux corresponding to the 
reference stationary dynamics under the control field V t for which V • J t y< = 0. Hence, with 
Ut the imposed field and V t its stationary modification, 

5Q? e * = 8Q? - 6QY (40) 
satisfies the generalized Clausius inequality 

S T -S > f SORT ( 41 ) 



JO 

which again becomes an equality in the quasi-static limit, by the same arguments as before. 
The result is similar but different from the one in P, [l(3] by our use of the modified minimum 
entropy production principle and the treating here of a somewhat broader class of free 
energy functionals and possible driving mechanisms. As we have shown the reason is that 
the arguments of Section IIVI allow for an almost immediate extension to macroscopic bulk- 
driven diffusions of the form (jSJ) in which the diffusion matrix D becomes density-dependent. 



VI. TIME-REVERSAL CONSIDERATIONS 



We have seen that the proper definition of the (finite) heat component truly associated 
with the transformation between steady states rather than with maintaining them, is the key 
ingredient in virtually all generalizations of the Clausius heat theorem to nonequilibrium. 
Nevertheless, other types of formal extensions may of course be invented. The present 
section gives such other point of view, using the different symmetry properties of both 
heat components under a suitable reversal operation, staying on the one hand close to the 
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Hatano-Sasa approach of Section IIII Al as also formulated in 18j , and on the other hand 
applying a time-reversal operation intimately related to our construction of the modified 
excess in Section |IVl 

In the original formulation, our model is specified by the protocol (U t ; f t , (3 t , -Dt)t=o °f 
externally controlled parameters, and the trajectory (/ii)[ =0 of evolved distributions obeys 
the Smoluchowski equation (jSJ). We now take a dual point of view and we see the latter, 
fi+ V- = 0, as an equation for the time-dependent potential (U t ) T t=0 such that a prescribed 
trajectory of densities (/x*)t=o actually takes place. Obviously, this is a non-stationary gen- 
eralization of the inverse problem considered in Section TlV Al According to (j!9p . this can be 
seen as a Legendre transformation from the potential U to its conjugated field Sa u (fj,)/5fi 



as generated by the functional a u (fi). This inverse problem was introduced in 22] in the 
context of (non-stationary) dynamical fluctuations. 

In our new picture, the time-evolved system is fully described in terms of the "imposed" 
trajectory (ju t ; f t , fit, D t )l =0 of both the states and of the protocol, whereas the potential 
(Ut)l=Q becomes a dependent quantity determined from the Smoluchowski equation (up to 
a constant). We now consider reversed trajectories (for simplicity, let D t = 1 in the sequel) 

{li t ; ft, f3 t y = (firs, fl_ t , f3 T . t ) , ft = -/ T _ t + VW-t (42) 

where ipt can be chosen arbitrarily. Then we check that if XJ t is the solution to the (inverse- 
problem) Smoluchowski equation for (// t ; f t , (3 t ) then 

U\ = ^ t - U T ^ t + log pi T _ t (43) 

is the solution to the Smoluchowski equation for (fi t ; f t , (3tY ■ Indeed, from fT431) we have 

j} = j$ = f4Pi(f}-vut)-vA 

Mi 

= -fAr-tPr-t {fr-t ~ VU T . t ) + V/i r _ t (44) 
= —Jr-t 

and since ji\ = —fi T ^ t , the equality fi\ + V • j\ = is proven. As a consequence, the heat in 
the time-reversed scenario (1421) is 

5Q\ 



dt 



(vuj - ft) ■ 4 dx 

(45) 

+ 2p~} t / Vlog/x T _ t - J T -tdx 



SQr-t 
dt 
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and by time integration we obtain our final result 

S(ii t ) - S(fio) = -J dt J V log ^ • J t dx 
1 

~ 2 



i r (46) 

- J {fit SQt - p} SQl) 



true without further conditions. 

That extended form of Clausius equality staying valid beyond the quasi-static regime is our 
second main result. In words, it relates the change of a system's (Shannon) entropy to the 
time-reversal antisymmetric component of the entropy flux. There is no need to explicitly 
mention an excess heat since that is now replaced by the antisymmetrization procedure. Note 
however that we have employed here a non-standard time-reversal operation (142]) which 
ensures the exact current reversal (|44[) . The inherent arbitrariness (via the free "gauge 
potential" ip) is related to the physical non-uniqueness of the decomposition of the force 
into gradient and non-gradient components. 



VII. CONCLUSION 



We have derived an extended Clausius heat theorem for overdamped diffusion processes, 
which remains valid arbitrarily far from equilibrium. The idea has been to modify previously 
adopted heat decomposition schemes according to an exact modification of the Minimum 
Entropy Production Principle, which naturally emerges from the structure of dynamical fluc- 
tuations. Our removed "house-keeping" heat does correspond to an operationally accessible 
steady-state flux, though with respect to a steady state obtained from solving a modified 
(inverse) stationary problem. Moreover, the generalized Clausius (in)equality proposed here 
is not restricted to a close-to-equilibrium regime. We have also discussed an extension to a 
class of driven macroscopic diffusions. In fact, the structure of the argument remains exactly 
intact for diffusing fields where the fields correspond to macroscopic profiles of interacting 
particles in a diffusive continuum approximation. 

The basic reason for the restriction to overdamped diffusions (finite or infinite dimen- 
sional) is due to the fact that the fluctuation relation (1281) in terms of the entropy produc- 
tion is no longer valid beyond the diffusion regime. For discrete jump process like, e.g., 
chemical networks, the rate function for occupation times does retain a similar structure as 
in PS|) but with the entropy production cr u (}J,) being replaced with another function called 



21 



dynamical activity (or "traffic"), which becomes essentially different from the entropy pro- 
duction unless the system is close to equilibrium and the deviations from stationarity are 
small {(], Q]. Within the proposed scheme, we still can check that the Clausius equality 
remains approximately valid up to first order around detailed balance, which (partially) 
reproduces the results from jj]. It still remains to be seen how the dynamical fluctuation 
framework proposed above can be used to analyze heat processes for strongly nonequilibrium 
jump processes and in systems with inertial degrees of freedom. 
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